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INTERACTIVE DECISION-MAKING SCENARIOS IN AN AUDIO/VIDEO 
BROADCAST 



FIELD OF THE INVENTION 

[0001] The present invention relates generally to data communications 

and, more particularly, to interactive decision-making scenarios in an 
audio/video broadcast. 

BACKGROUND 

[0002] Current audio/ video broadcasts do not allow viewers any interaction 
with programs broadcasted by content providers, for example television 
networks and cable channel providers, or with the advertisements presented on 
the viewers' television sets. Whether viewers like or dislike the outcome of the 
programs they watch, they cannot influence that outcome and cannot filter or 
restrict the constant flow of advertisements presented by the content providers. 
[0003] Even if viewer interaction with broadcasted programs and/or 
advertisements is limited, in other areas, interactive solutions have been devised 
to allow some level of user interaction. But these interactions are also narrow in 
scope and do not provide feedback based on the users' past actions and viewing 
habits. 

[0004] For example, in the optical recording area, audio/video programs, for 
example motion pictures, may include multiple alternate plots and endings, 
which are previously recorded on the various available optical media. Using 
prerecorded interactive menus, viewers are prompted to choose between the 
alternate plots and endings when viewing the programs. 
[0005] Similarly, in the video or computer games area, users may interact 
with certain aspects of the video or computer games, and may choose to interact 
with characters within the games using predetermined pop-up menus. 
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SUMMARY 

[0006] Interactive decision-making scenarios in an audio /video broadcast are 
described. A profile of a user and content information associated with a selected 
content file are retrieved in response to a selection input command from the 
user, the selection input command selecting the content file for transmission to 
the user. A play sequence of the content file is further selected based on the user 
profile and the content information. Finally, the selected play sequence is 
presented to the user. 

[0007] Other features and advantages of the present invention will be 
apparent from the accompanying drawings and from the detailed description 
that follows. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0008] The present invention is illustrated by way of example and not 
limitation in the figures of the accompanying drawings, in which like references 
indicate similar elements and in which: 

[0009] Figure 1 is a block diagram of one embodiment for an audio/ video 
broadcast system architecture. 

[0010] Figure 2 is a block diagram of one embodiment for a content file 
having multiple content segments. 

[0011] Figure 3 is a block diagram of one embodiment for a selection device 
within the audio/video broadcast system. 

[0012] Figure 4 is a timing diagram of one embodiment for a method for 
interactive selection of a play sequence of a content file based on user profile and 
explicit input from a user. 

[0013] Figure 5 is a flow diagram of one embodiment for the method for 
interactive selection of a play sequence of a content file based on user profile and 
explicit input from a user. 
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DETAILED DESCRIPTION 

[0014] According to embodiments described herein, interactive decision- 
making scenarios in an audio/ video broadcast are described. 
[0015] In the following detailed description of embodiments of the invention, 
reference is made to the accompanying drawings in which like references 
indicate similar elements, and in which are shown by way of illustration specific 
embodiments in which the invention may be practiced. These embodiments are 
described in sufficient detail to enable those skilled in the art to practice the 
invention, and it is to be understood that other embodiments may be utilized 
and that logical, mechanical, electrical, functional, and other changes may be 
made without departing from the scope of the present invention. The following 
detailed description is, therefore, not to be taken in a limiting sense, and the 
scope of the present invention is defined only by the appended claims. 
[0016] Figure 1 is a block diagram of one embodiment for an audio /video 
broadcast system architecture. Referring to Figure 1, the block diagram 
illustrates the environment in which the present invention operates. In the 
audio /video broadcast system architecture 100, multiple content providers 110, 
for example audio/video broadcasters, such as television networks and/or cable 
channel providers, are coupled to a selection device 120. Content providers 110 
transmit content files, for example audio/video data, such as television or cable 
channel programs or advertisements, to the selection device 120. In one 
embodiment, selection device 120 stores the content files and communicates 
with one or more users 130 through a network 140 to present the content files 
upon requests received from users 130. 

[0017] In one embodiment, network 140 is a local area network (LAN). Users 
130 communicate with each other through the network 140 and communicate 
with selection device 120 directly or through a gateway computer system (not 
shown). In one embodiment, users 130 receive content files stored in the 
selection device 120 upon transmitting a request to the selection device 120. 
Alternatively, users 130 may act as content providers and may transmit content 
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information, such as content files, to the selection device 120 for storage. The 
stored content information transmitted by any user 130 may then be shared with 
other users 130 via LAN 140. 

[0018] In an alternate embodiment, network 140 may be a wide-area network 
(WAN). Wide-area network 140 includes the Internet, specifically the World 
Wide Web, or other proprietary networks, such as America Online™, 
CompuServe™, Microsoft Network™, and/or Prodigy™, each of which are well 
known to those of ordinary skill in the art. Wide-area network 140 may also 
include conventional network backbones, long-haul telephone lines, Internet 
service providers, various levels of network routers, and other conventional 
means for routing data between devices. Using conventional network protocols, 
selection device 120 may communicate through wide-area network 140 with 
multiple users 130, possibly connected through wide-area network 140 in 
various ways or directly connected to selection device 120. For example, as 
shown in the embodiment of Figure 1, users 130 are connected directly to wide- 
area network 140 through a digital broadband connection, or a direct or dial-up 
telephone connection or other network transmission line. Alternatively, users 
130 may be connected to wide-area network 140 through a conventional modem 
pool (not shown) or other type of connection. 

[0019] In one embodiment, multiple users 130 may also be interconnected 
using the wide-area network 140 and may communicate with each other through 
the wide-area network 140. If the World Wide Web portion of the Internet is 
used as wide-area network 140, users 130 may communicate across the World 
Wide Web using the Hyper Text Transfer Protocol (HTTP) and the Hyper Text 
Markup Language (HTML). In this configuration, users 130 use an application 
program known as a web browser, for example the Netscape Navigator™ 
browser, published by America Online™, the Internet Explorer™ browser, 
published by Microsoft Corporation of Redmond, Washington, the user interface 
of America Online™, or the web browser or HTML translator of any other 
conventional supplier. Conventional means exist by which users 130 may 
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supply information to selection device 120 through the wide-area network 140 
and the selection device 120 may return information to users 130. 
[0020] In one embodiment, content files from each content provider 110 are 
transmitted continuously and are selectively stored within selection device 120. 
Alternatively, content files may be transmitted at predeteirnined intervals from 
one or more content providers 110. In one embodiment, content files are stored 
within selection device 120 based on user profiles associated with each user 130, 
which are also stored in the selection device 120. In one embodiment, user 
profiles are sets of rules describing the viewing preferences of each user 130, for 
example subjects or areas of interest, favorite characters, shows, or motion 
pictures, as well as consumer interests for advertising purposes. Content files 
will be described in further detail below. 

[0021] Figure 2 is a block diagram of one embodiment for a content file 
having multiple content segments. As illustrated in Figure 2, content file 200 
includes multiple content segments 210 through 250, each content segment 
having associated content segment information, for example metadata 212 
through 252, respectively. In one embodiment, each content segment 210 
through 250 includes audio/ video data to be presented to users 130, for example 
broadcasted programs and advertisements. 

[0022] In one embodiment, each metadata 212 through 252 includes content 
information about its respective associated content segment 210 through 250, for 
example a description of the corresponding content segment, news information, 
and promotional information directed to users 130. In one embodiment, 
metadata 212 through 252 are linked together and further contain information 
about each other. The linked metadata 212-252 are configured to specify one or 
more play sequences for the content file 200, each play sequence incorporating a 
number of content segments 210-250 in a predetermined order. 
[0023] In one embodiment, content file 200 is a broadcasted program, for 
example a motion picture, having alternate story lines. Each content segment 
210-250 contains one alternate story line. In one embodiment, content segment 
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210 contains the main story line and metadata 212 contains information about 
the main story line. In one embodiment, each content segment 220 through 250 
contains a story line alternate to the main story line stored within content 
segment 210. In one embodiment, metadata 212 is linked to metadata 222, which 
in turn is linked to metadata 232 and 242. At the same time, metadata 232 and 
242 are both linked to metadata 252. 

[0024] In one embodiment, a play sequence for content file 200, starting with 
content segment 210, which represents the main story line, is presented to users 
130. The play sequence including content segment 210 is presented in 
uninterrupted form to users 130. Alternatively, the play sequence may change 
based on the profiles of users 130 or explicit inputs received from users 130. 
[0025] In one embodiment, after a predetermined period of time, the play 
sequence is modified to include the presentation of an alternate story line 
contained within content segments 220, 230, or 240. Based on a profile of a user 
130 receiving the play sequence or based on an input received from the user 130, 
since metadata 212 is linked to metadata 222, the play sequence is modified 
accordingly to present content segment 220 to the user 130. Alternatively, the 
presentation may switch to one of content segments 230 or 240. 
[0026] After another predetermined period of time, the play sequence 
transmitted may change again and a new play sequence including content 
segment 250 may be presented to the user 130. 

[0027] In an alternate embodiment, content file 200 further includes 
advertisements directed to a user 130. In one embodiment, the advertisements 
within content file 200 are presented to the user 130 based on the corresponding 
user profile. Considering the consumer interests of the user 130 stored in the 
user profile, selection device 120 presents targeted advertisements to user 130. 
Alternatively, the advertisements may be presented to user 130 based on explicit 
inputs, for example explicit input commands, received from user 130. User 130 
prompts selection device 120 to present one or more specific advertisements. 
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Selection device 120 receives the request and supplies only advertisements that 
match the user's request. 

[0028] Figure 3 is a block diagram of one embodiment for a selection device 
within the audio/video broadcast system. As illustrated in Figure 3, selection 
device 120 includes a storage module 330, which stores content files 200 
broadcasted by content providers 110 or transmitted by users 130, and user 
profiles of users 130, for example implicit user profiles, each implicit user profile 
including information regarding viewing habits of users 130, for example 
subjects and areas of interest, previous programs viewed by a user 130, and/ or 
favorite advertising subjects. In one embodiment, storage module 330 further 
includes a content storage area, which stores the content files 200, and a profile 
storage area, which stores the implicit user profiles. 

[0029] In one embodiment, selection device 120 further includes a control 
module 320 coupled to the storage module 330. The control module 320 
retrieves selected content files 200 stored in the content storage area of the 
storage module 330 in response to selection input commands from users 130, 
and selects predetermined play sequences of each selected content file 200 based 
on the implicit user profiles of users 130 and further selection input commands 
received from users 130. In one embodiment, selection device 120 further 
includes a presentation module 310 coupled to control module 320 for 
presenting the play sequences and advertising material to users 130. 
[0030] Figure 4 is a timing diagram of one embodiment for a method for 
interactive selection of a play sequence of a content file based on user profile and 
explicit input from a user. As illustrated in Figure 4, at state 401, a request to 
present an interactive list of available data is transmitted from presentation 
module 310 to control module 320. In one embodiment, user 130 transmits the 
request to retrieve an interactive list of content files 200 to the presentation 
module 310 within selection module 120. Presentation module 310 contacts the 
control module 320 and requests the interactive list of content files 200. 
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[0031] At state 402, a request to retrieve available data is transmitted to the 
storage module 330. In one embodiment, control module 320 forwards the 
request to retrieve available content files 200 to the content storage area of the 
storage module 330. 

[0032] At state 403, storage module 330 returns available data to control 
module 320. In one embodiment, the content storage area of the storage module 
330 returns the content files 200 stored within the storage module 330 and 
available for presentation to control module 320. 

[0033] At state 404, a request to retrieve the profile of user 130 is transmitted 
to the storage module 330. In one embodiment, control module 320 transmits 
the request to retrieve the implicit user profile of user 130 to the profile storage 
area of storage module 330. 

[0034] At state 405, storage module 330 returns the user profile of user 130 to 
the control module 320. In one embodiment, the profile storage area of storage 
module 330 receives the request and returns the user profile to control module 
320. In one embodiment, the implicit user profile includes categories of 
programs and advertisements most watched by user 130. Alternatively, the 
implicit user profile may include other information enabling control module 320 
to compile the interactive list of content files 200. 

[0035] At state 406, control module 320 processes the available data and 
matches the data with the user profile of user 130 to create the interactive data 
list. In one embodiment, control module 320 matches the content files 200 
received from storage module 330 with the stored user profile and creates the 
interactive list of content files 200 to be presented to user 130. 
[0036] At state 407, the interactive data list is transmitted to the presentation 
module 310. In one embodiment, control module 320 transmits the interactive 
list of content files 200 to the presentation module 310. 

[0037] At state 408, presentation module 310 presents the interactive data list 
to user 130 and waits for a selection input command from the user 130. In one 
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embodiment, the interactive data list contains interactive menu selections, which 
allow user 130 to select a content file 200 from the list of content files presented. 
[0038] At state 409, after user 130 selects data from the interactive data list, 
presentation module 310 transmits the selection input command to control 
module 320 for further processing. 

[0039] At state 410, a request to retrieve metadata associated with the 
selected data is transmitted to the storage module 330. In one embodiment, 
control module 320 requests metadata 212-252 associated with the selected 
content file 200 from the content storage area of the storage module 330. In one 
embodiment, metadata 212 contains information pertaining to content segment 
210 within the selected content file 200. Metadata 212 also contains links to other 
metadata 222-252 associated with respective content segments 220-250 within 
content file 200. 

[0040] At state 411, metadata is returned to the control module 320. In one 
embodiment, the content storage area of the storage module 330 transmits 
metadata 212-252 to the control module 320. 

[0041] At state 412, a request to retrieve a detailed user profile of user 130 is 
transmitted to the storage module 330. In one embodiment, control module 
requests the detailed user profile from the profile storage area of the storage 
module 330. In one embodiment, the detailed user profile includes detailed 
information about past viewing habits of user 130, for example frequently 
watched programs and advertisements and the user's favorite types of 
prograrnrning. Alternatively, the detailed user profile may include other 
information pertaining to the user 130. 

[0042] At state 413, the detailed user profile is returned to the control module 
320. In one embodiment, the profile storage area of the storage module 330 
transmits the detailed user profile to the control module 320 for further 
processing. 

[0043] At state 414, control module 320 processes and matches the metadata 
corresponding to the selected data with the detailed user profile to select a play 
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sequence of the selected data. In one embodiment, control module 320 processes 
metadata 212-252 associated with the selected content file 200 and selects a play 
sequence of the content segments 210-250 within the selected content file 200 
based on the detailed user profile of the user 130. At the same time, control 
module processes metadata 212-252 to select advertisements compatible with the 
detailed user profile of user 130. 

[0044] At state 415, the selected play sequence is transmitted to the 
presentation module 310. In one embodiment, control module 320 transmits the 
selected play sequence to be presented to user 130. In one embodiment, the 
selected play sequence includes one or more of the content segments 210 
through 250 in a predetermined order dictated by metadata 212. Alternatively, 
control module 320 also transmits advertising material together with the selected 
play sequence, for example the advertisements selected by control module 320 
based on the detailed user profile of user 130. 

[0045] At state 416, presentation module 310 waits for explicit input from 
user 130, while presenting the selected content file 200 in the selected play 
sequence to the user 130. 

[0046] At state 417, an input from user 130 is transmitted to control module 
320. In one embodiment, user 130 decides to change the selected play sequence 
of the content file 200 and requests a modified play sequence using interactive 
menu selections provided by presentation module 310. Presentation module 310 
receives the explicit input command from user 130 requesting the modified play 
sequence and transmits the explicit input command to the control module 320. 
In an alternate embodiment, user 130 may also use the explicit input command 
to request specific advertisements using the interactive menu selections. 
[0047] At state 418, the input is processed and a modified play sequence is 
selected. In one embodiment, control module 320 processes the explicit input 
command received from presentation module 310 and selects the modified play 
sequence. In one embodiment, the modified play sequence includes one or more 
of content segments 210 through 250 in an order specified by the explicit input 
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signal. In an alternate embodiment, control module 320 also selects the specific 
advertisements requested by user 130. 

[0048] Finally, at state 419, control module 320 transmits the modified play 
sequence of the content file 200 to the presentation module 310. In addition, if 
requested by user 130, control module also transmits the requested 
advertisements. Presentation module 310 then presents the modified play 
sequence and requested advertisements to user 130. 

[0049] Figure 5 is a flow diagram of one embodiment for the method for 
interactive selection of a play sequence of a content file based on user profile and 
explicit input from a user. As illustrated in Figure 5, at processing block 510, a 
request to present an interactive list of available data is received from a user 130. 
In one embodiment, the presentation module 310 receives the request and 
forwards the request to control module 320. 

[0050] At processing block 520, available data and a profile of user 130 are 
retrieved. In one embodiment, control module 320 communicates with storage 
module 330 and retrieves the stored content files 200 from the content storage 
area and the implicit user profile from the profile storage area of the storage 
module 330. 

[0051] At processing block 530, available data and the user profile are 
processed to create a list for user 130. In one embodiment, control module 320 
processes the retrieved content files 200 and the user profile to create an 
interactive list of content files 200 that match the user profile. 
[0052] At processing block 540, the interactive list is transmitted to the user 
130. In one embodiment, control module 320 transmits the interactive list of 
available content files 200 to the presentation module 310, which further 
presents the list to the user 130 along with interactive menu selections. 
[0053] At processing block 550, a selection of data from the interactive list is 
received. In one embodiment, presentation module 310 receives a selection 
input command from user 130, which selects a content file 200 from the 
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interactive list. Presentation module 310 further transmits the selection input 
command to control module 320 for further processing. 
[0054] At processing block 560, metadata associated with the selected data 
and a detailed user profile of user 130 are retrieved. In one embodiment, control 
module 320 communicates with storage module 330 and retrieves metadata 
associated with the selected content file 200 from the content storage area of the 
storage module 330 and the detailed user profile from the profile storage area of 
the storage module 330. 

[0055] At processing block 570, the retrieved metadata and the detailed user 
profile are processed to select a play sequence of the selected data. In one 
embodiment, control module 320 processes and matches the metadata associated 
to the selected content file 200 with the detailed user profile to create the play 
sequence of content segments 210-250 within the selected content file 200. 
Alternatively, in addition to creating the play sequence, control module 320 also 
processes metadata to select advertisements to be presented to user 130. 
[0056] At processing block 575, the selected play sequence is transmitted to 
user 130. In one embodiment, control module 320 transmits the selected play 
sequence to the presentation module 310. Presentation module 310 presents the 
play sequence to the user 130 and waits for explicit input from user 130. 
Alternatively, in addition to the play sequence, selected advertisements are also 
presented to user 130. 

[0057] At processing block 580, a decision is made whether further input is 
received from user 130. In one embodiment, if no further input is received from 
user, presentation module 310 continues to present the selected play sequence to 
user 130 and block 575 is repeated. 

[0058] Otherwise, if an explicit input is received from user 130, at processing 
block 590, the input is processed to select a modified play sequence. In one 
embodiment, presentation module 310 receives the explicit input command from 
user 130 and transmits the input command to the control module 320. Control 
module 320 processes the explicit input command and creates the modified play 
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sequence of content segments 210-250 within the selected content file 200. 
Alternatively, the explicit input command may also contain a request to present 
specific advertisements in addition to the modified play sequence. Control 
module 320 processes the explicit input command to select the requested 
advertisements. 

[0059] Finally, at processing block 595, the modified play sequence is 
transmitted to user 130. In one embodiment, control module 320 transmits the 
modified play sequence to the presentation module 310, which further presents 
the modified play sequence to the user 130. Alternatively, in addition to the 
modified play sequence, control module 320 may also transmit the requested 
advertisements to the presentation module 310, which in turn presents them to 
user 130. 

[0060] It is to be understood that embodiments of this invention may be used 
as or to support software programs executed upon some form of processing core 
(such as the CPU of a computer) or otherwise implemented or realized upon or 
within a machine or computer readable medium. A machine readable medium 
includes any mechanism for storing or transmitting information in a form 
readable by a machine (e.g., a computer). For example, a machine readable 
medium includes read-only memory (ROM); random access memory (RAM); 
magnetic disk storage media; optical storage media; flash memory devices; 
electrical, optical, acoustical or other form of propagated signals (e.g., carrier 
waves, infrared signals, digital signals, etc.); or any other type of media suitable 
for storing or transmitting information. 

[0061] In the foregoing specification, the invention has been described with 
reference to specific exemplary embodiments thereof. It will, however, be 
evident that various modifications and changes may be made thereto without 
departing from the broader spirit and scope of the invention as set forth in the 
appended claims. The specification and drawings are, accordingly, to be 
regarded in an illustrative rather than a restrictive sense. 
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